Event-VPR: End-to-End Weakly Supervised Deep Network Architecture for Visual Place Recognition Using Event-Based Vision Sensor
نویسندگان
چکیده
Traditional visual place recognition (VPR) methods generally use frame-based cameras, which will easily fail due to rapid illumination changes or fast motion. To overcome this, we propose an end-to-end VPR network using event can achieve good performance in challenging environments (e.g., large-scale driving scenes). The key idea of the proposed algorithm is first characterize streams with EST voxel grid representation, then extract features a deep residual network, and, finally, aggregate improved VLAD realize streams. verify effectiveness algorithm, on event-based datasets (MVSEC, DDD17, and Brisbane-Event-VPR) synthetic (Oxford RobotCar CARLA), analyze our method sequences, including cross-weather, cross-season, changing scenes, then, compare state-of-the-art (Ensemble-Event-VPR) prove its advantages. Experimental results show that better than ensemble scheme scenarios. best knowledge, for task, this weakly supervised architecture directly processes stream data.
منابع مشابه
End-to-end weakly-supervised semantic alignment
We tackle the task of semantic alignment where the goal is to compute dense semantic correspondence aligning two images depicting objects of the same category. This is a challenging task due to large intra-class variation, changes in viewpoint and background clutter. We present the following three principal contributions. First, we develop a convolutional neural network architecture for semanti...
متن کاملSupervised Hashing with End-to-End Binary Deep Neural Network
Image hashing is a popular technique applied to large scale content-based visual retrieval due to its compact and efficient binary codes. Our work proposes a new end-to-end deep network architecture for supervised hashing which directly learns binary codes from input images and maintains good properties over binary codes such as similarity preservation, independence, and balancing. Furthermore,...
متن کاملEnd-to-end Delay Analysis for Event-driven Wireless Sensor Network Applications
The end-to-end delay is one of the most critical and fundamental issues for wireless sensor networks. Many applications of sensor networks require an end-to-end delay guarantee for time sensitive data. However, the end-to-end delay is difficult to bound for event-driven sensor networks, where nodes generate and propagate data only when an event of interest occurs, thereby producing unpredictabl...
متن کاملEnd-to-End Deep Neural Network for Automatic Speech Recognition
We investigate the efficacy of deep neural networks on speech recognition. Specifically, we implement an end-to-end deep learning system that utilizes mel-filter bank features to directly output to spoken phonemes without the need of a traditional Hidden Markov Model for decoding. The system will comprise of two variants of neural networks for phoneme recognition. In particular, we utilize conv...
متن کاملEnd-to-End Deep Learning for Driver Distraction Recognition
In this paper, an end-to-end deep learning solution for driver distraction recognition is presented. In the proposed framework, the features from pre-trained convolutional neural networks VGG-19 are extracted. Despite the variation in illumination conditions, camera position, driver’s ethnicity, and genders in our dataset, our best fine-tuned model, VGG-19 has achieved the highest test accuracy...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Instrumentation and Measurement
سال: 2022
ISSN: ['1557-9662', '0018-9456']
DOI: https://doi.org/10.1109/tim.2022.3168892